Web Crawler

美 [?web ?kr?l?r] 　英 [?web ?kr??l?(r)]

• n.網(wǎng)路蜘蛛
• 網(wǎng)絡(luò)網(wǎng)絡(luò)爬蟲；網(wǎng)絡(luò)爬蟲或網(wǎng)絡(luò)蜘蛛；網(wǎng)路爬蟲

詞形變化

復(fù)數(shù)：web crawlers  

英漢解釋

n.	1. 網(wǎng)路蜘蛛

英英解釋

n.	1. a program used for searching through websites on the Internet for documents containing a particular word, phrase, or subject

例句

If you avoid non-local links and dig down only into local Web pages, you provide a Web crawler for a single Web site, as shown in Listing 7.

如果能夠避免非本地的鏈接而只訪問本地Web頁面，就可以為這個單一Web站點提供Web爬蟲了，如清單7所示。

The sitemap files can then be used to indicate to a web crawler how such pages can be found.

在Sitemap文件可以用來顯示的Web抓取工具如何對這些網(wǎng)頁可以找到。

On this basis, the author proposed the implementation of this paper-content detection based on the web crawler technology.

在此基礎(chǔ)上提出本文所選用的實現(xiàn)方案——基于網(wǎng)絡(luò)爬蟲技術(shù)的內(nèi)容探測技術(shù)。

Each search engine has its own automated program called a "web spider" or "web crawler" that crawls the web.

每個搜索引擎都有自己爬行網(wǎng)頁的自動化程序，叫做“網(wǎng)絡(luò)蜘蛛（webspider）”或“網(wǎng)絡(luò)爬蟲（webcrawler）”。

The CollectUrls Web crawler program takes advantage of a fixed-size thread pool.

CollectUrlsWebcrawler程序利用一個固定大小的線程池。

Generally, search engine is consisting of web crawler, index construction, retrieval and user interface.

一般來說，搜索引擎都由搜索器、索引器、檢索器和用戶接口四個部分組成。

First, all frequent phrases that Spock extracts using its semantic technology via its web crawler become tags.

首先，Spock使用語義學(xué)技術(shù)、通過網(wǎng)絡(luò)爬蟲系統(tǒng)采集到的所有常用短語都會成為標簽。

This information helps the Web crawler determine what the set of pages is and when to crawl them.

這一信息能幫助web爬蟲程序決定要爬行哪些頁面以及爬行的時間。

Gets a value indicating whether the browser is a search engine Web crawler.

獲取一個值，該值指示瀏覽器是否為Web爬行遍歷搜索引擎。

And real project experience in the areas of web crawler, search engines and information retrieval is a plus.

因此我們優(yōu)先錄取在網(wǎng)絡(luò)爬蟲開發(fā)、搜索引擎開發(fā)和信息檢索等方面具有深厚技術(shù)基礎(chǔ)的候選人。

If using a web crawler, this could be done by publishing a web page on a local site running on IBM HTTP Server.

如果使用的是web爬行器，那么可以通過在IBMHTTPServer上運行的本地站點中發(fā)布一個web頁面實現(xiàn)。

A MapReduce application or a web crawler application fits perfectly with this model.

典型的如MapReduce框架，或者一個webcrawler應(yīng)用都很適合這個模型。

A lot of bad web crawler, often complicated by dozens of hundreds of requests to grab cycle is repeated.

很多糟糕的網(wǎng)絡(luò)爬蟲，經(jīng)常并發(fā)幾十上百個請求循環(huán)重復(fù)抓取。

We designed a deep web crawler base on the most efficient queries.

本文提出一種基于最優(yōu)查詢詞的深度網(wǎng)絡(luò)爬蟲。

The focused web crawler has been became a researching hotspot in technology domain of searching engine.

聚焦網(wǎng)絡(luò)爬蟲已經(jīng)成為搜索引擎技術(shù)領(lǐng)域的一個研究熱點，對于專業(yè)領(lǐng)域的搜索產(chǎn)生重要的作用。

Finally, it is illustrated to the future of Web crawler search engine research trends.

最后對搜索引擎未來網(wǎng)絡(luò)爬蟲研究趨勢做了說明。

Figure 4 shows a snapshot of a Web crawler that is processing the whitehouse. gov site.

圖4顯示了正在處理whitehouse.gov站點的Web搜尋程序的快照。

Firstly, we introduce the main function of the web crawler and the present condition of technology of web crawler;

論文首先介紹了網(wǎng)絡(luò)爬蟲所起的作用以及網(wǎng)絡(luò)爬蟲技術(shù)的發(fā)展現(xiàn)狀；

Design of A Multi-strategy Topic Specific Web Crawler

多策略的主題集中式萬維網(wǎng)爬蟲設(shè)計

The Implement and Design of a Prototype Web Crawler

一種主題型Web爬行器的設(shè)計和實現(xiàn)

Research and Realization of Intelligent Focused Web Crawler

基于主題的智能Web信息采集系統(tǒng)的研究與實現(xiàn)

Improved algorithm about topic web crawler's search strategy

一種改進的主題網(wǎng)絡(luò)蜘蛛搜索算法

One Solution About Topic Web Crawler's Greedy Search Strategy

主題網(wǎng)絡(luò)蜘蛛搜索策略貪婪性解決方法

Analysis on Web Crawler's Searching Strategies

簡析搜索引擎中網(wǎng)絡(luò)爬蟲的搜索策略

Analysis and Design of Distributed Web Crawler

分布式Web信息采集系統(tǒng)的研究與設(shè)計

Design and implementation of focused Web crawler based on semantic analysis

基于語義分析的主題信息采集系統(tǒng)的設(shè)計與實現(xiàn)

Research and Design of Customized Web Crawler Based on Web Page Segmentation

基于網(wǎng)頁分塊的個性化信息采集的研究與設(shè)計

On the research and design of deep web crawler

爬蟲研究與設(shè)計